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Technical Field 

This invention relates to a method of monitoring a 
monitored location, a monitoring system and a monitoring 
module for monitoring. 
Dackaround Art 

Monitoring of various public places, business pre- 
mises and private homes is becoming increasingly impor- 
tant as they contain increasingly valuable equipment, 
both of economic value, such as expensive computer equip* 
ment , and sentimental value, such as family heirlooms. 

In order to meet these increased monitoring needs , 
there are different types of monitoring systems. One type 
of mrvni taring system according to prior art normally com- 
prises a monitoring station and a number of moniUoi iny 
modules, each of which monitors a monitored location . 
Racb monitoring module is connected to a monitoring sta- 
tion via communication cables* Traditionally, a monitor- 
inq module is a video camera which continually records 
images which srp. transmitted to the monitoring station. 
In the monitoring station there are one or more aid-Liu 
ujue-LciLors , who watch the transmitted images to decide 
whethfir sny unauthorized activity is taking place, such 
as a bjprglar appearing at the monitored location. The 
disadvcuiLdye ul this system is that the alarm operators 
must be paying attention continuously if t.bp.rp is anyone 
in the transmitted images. Thic cevcrcly limit 3 the num- 
ber of monitoring modules that can be connected Lu Lhe 
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moTi-i toring station, which, also results in the monitoring 
being very expensive. In order to reduce the qucLuLiLy ul 
imaqes transmitted to che monitoring station, the moni- 
toring module comprises a video camera and an infrared 
detector which are connected to each other. When the 
infrared detector detects a movement, a video recording 
ir Rtarted. The video images can be transmitted via the 
communication cables to the monitoring station wheats an 
operator views the imaqes and makes a decision regarding 
measures to be taken. A problem with this type of moni- 
toring system is that in many cases the recorded images 
do not provide sufficient information about what has 
ranged the alarm. This can occur when, for example, 
alarm situations, detected by the infrared detector, 
which have been caused by high temperatures or sabotage 
are not? caught by the camera. In addition, the system 
□till transmits a relatively large quantity of data. 

Patent application WO 98/28/Ub describes a monitor- 
ing syffit-.RTTi whinh comprises a number of cameras that are 
connected to a monitoring station- The cameras record 
images Lht=tL ctre transmitted to the monitoring station. 
The mnnitnn'rig station processes the images to determine 
whether there io an alarm situation or not- If it is 
deLermined that there is an alarm situation, an alarm 
signal is rorwarded. 
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Summa-rv of thf* Tnvpntiori 

An object of the invention is therefore to make pos- 
sible reliable and cost-ef f ective monitoring and thereby 
to solve the above - mont ioned problem. 

The monitoring system must also in a completely 
satisfactory way make it possible to protect the privacy 
of persons whn atr at the monitored location. 

The characteristics which belong to the extracted 
died dkti be calculated from data which represents the 
sty I i zftii area . 

These and other objects/ which will become apparent 
fiuiu Llie following description, have now been achieved by 
a method ot monitoring in snnordance with claim 1. 

The invention is baaed on the knowledge of the 
adYdiiLdyea ul wurkixiH with oblects which are extracted 
trom an arw. The arp^ i.s a representation of an object 
which is detected at a monitored location. The object is 
created by pj-uduuiny some particular characteristics of 
the area, such as a stylize.ri ouM itir nhape of the area. 
In other wordc , the object contains a reduced and limited 
amount^of inf ormctLioii dbuuL the area, which information 
is sufficient to ensure whehhfir there is an alarm situa- 
tion or not. By working with objecte it io possible to 
create a first type of ob j euL which iss used for classi- 
fication and a second type of object which is transmitted 
to a monitoring station for visual verification. These 
two types of object consist of the actual object or a 
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subset of the actual object. In this way, classification 
of certain characteristics and a visual verification of 
other characteristics are made possible. 

According to one aspect, the invention thus com- 
prises a method, of monitoring monitored locations by 
means of a monitoring system comprising a plurality of 
TTinn-i t-.n-ri ng modules, each of which has a light -sensitive 
sensor, for monitoring the monitored locations, and a 
remote monitorinq station with an operator, comprising 
the steps o£ recording by each of the monitoring modules 
an image of the monitored location associated with the 
monitoring module, extracting in each of the monitoring 
mnriiilpR an area in the recorded image which differs from 
a reference image, extracting in each of the monitoring 
itiudulea an object from the area, classifying in each of 
the monitoring modules the object, based on characteris- 
tico, ouch as a characteristic of the type; size, shape 
and/or movement history, associated with the object, if 
the object i« a human a 1 arm object, transmitting, if the 
object io classified as a human alarm object, data repre- 
senting Lhe axea in a stylized way to the monitoring sta- 
tion, and rp.rrp.atiTig said transmitted data in the moni- 
toring station and dicplaying the 3ame to the operator 
for YeiificdLiun o£ the human alarm object. 

Thus, the invention comprises the step of rftnnrriing 
images of a monitored location and of producing from 
thece images information which is of interest for moiu- 
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f.oring piirpnRRa and transmit ting certain information to 
a monitoring station. 

The monitored location is limited by the light- 
«i=m.<qi t ive sensor and the field of vision of the associat- 
ed opticc. The monitoring station is remote and can be a 
ueiiLer belonqinq to a security company, security person- 
nel is t.hftn Rfinh to the monitored location immediately 
if an alarm ia verified. The monxtoring station can also, 
£ui example, be connected directly to the police. 

The recorded image is compared with a reference 
image to detect new objects and events in the image. The 
xefereuce image can be created by means of one or more 
algorithms from nnp nr more previous images, one or more 
baclcground images, or a combination of both, Averaginy 
can be uarxied out of a number of said recorded images 
to create, a rp.fprpnce image. By means of the comparison, 
moving objects can be further processed and stationary 
object-*, for example tables and chairs, that are in the 
monitored location ran he» excluded . This means that the 
areae contain interesting information about events in Lhe 
monitored lucdLiun. 

From the areas in thp image which are different from 
the reference image, at leact one characteristic is pro- 
duced to create an object. The characteristic should be 
of such a type that it is or interest to ar.nriy in the 
rp.lpvant monitoring situation. For example, if it is 
necessary to bo able to distinguish between animals and 

i 
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people?, certain «p«nif-ic characteristics, such as pat- 
ternc of movement! can suitably be used. An object is 
created. A ulctaa ificaLiuii based on one or more characuer- 
isr.ir! i f=; n^rri Rd ni.it to determine whether the object is 
a human alarm object. The monitoring system can be set up 
Lu classify the object: as a human alarm object as soon as 
an object is determined to bp a human object, but it can 
also be cet up to claooify the object as a human alarm 
object if the object its de Lex-mined to be human and also 
fulfils some additional rriterion, such as where in the 
image the human object io located. 

The decision can be reached based on a comparison 
With predetermined threshold values and/or- on charac- 
teristics of previoucly detected objects. 

The stylized depiuLiua of the object that is trans- 
mitted when the ohjert is classified as a human alarm 
object is suitable for narrow band transmission while at 
the same time beiiiy able to be interpreted by the human 
eye for a verification that it is artnally an alarm 
object. Data representing the atyliscd object comprises 
greatly data-reduced inf ortiuaLiuii dbuuL the extracted 
area. The data-reduced information still comprises suf- 
ficient information to enable it to be recreated in the 
monitoring station and displayed visually in such a way 
uhaL an operator can verify reliably that there is 
actually an alarm situation at the monitored location. 
An operator can, for example, be a security guard or 
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some other person who, in thp. Rvpnt of sn alarm being 
verified, contacts, for example, a security guard or the 
police . 

nat.a -representing tine area in a stylized way is 
trancmittcd via a communication medium, which, can be, for" 
example, a cable or a wireless connection, to a monitor- 
ing station. The object r.an be riispl syeri to the operator 
on, for example, a display screen. The operator thus 
makes an evaluation ol what he sees. If the operator, for 
flvamplp., jnHgppi that there 'is an intruder at the monitor- 
ed location, he takec cuitablc mcacurco, ouch ao sending 
security personnel to the location. On the other hand, if 
the operator judges that what he nan rrp. is not an alarm 
oituation, no further action need to be taken and money 
is bdvtid, ay no unnecessary work needs to be carried out. 
In addition, the hranRmiRRinn medium is not overloaded 
with superfluous data, as the trancmittcd object com 
jjiibtia a reduced and limited amount of information about 
the detected area. This means that a very large number 
of monitoring modulec can be connected to one monitoring 
station. Analysis and decisioii-makiiiy die distributed. 
All computer-based analysis? takes plnr.R in the. monitoring 
modules and it can be sufficient to have only human vcri 
fication of the transmitted iiiJTu-Luiatiuii in the monitorinq 
station, in addition, with the limited amount or infor- 
mation it is easy to construct a queue system for the 
received alarm information in the monitoring station. 
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Th^ characteristics on which the classification ic 
carried out can be calculated from data repress en Liny Llie 
aLylized area. The advantage of this is that the operator 
vfiriMes the decision whether there is an alarm situation 
or not uoing the same characteristics to make his deci- 
sion as the decision engine in the monitoring module. 

Tn nnp pmhod "i ment / the step is included of creating 
the outline shape of the area in order to represent Llm 
euLeri in a stylized way. 

Th.e outline shape can be made up of a sequence of 
pointo in the edge of the area. Data about the size and 
shape of the area can be calculated relatively easily 
trom the out M fir shapp . 

In one embodiment, the stylized area is a stylized 
outline fcilictpfc: . 

With thp Rf.yl i 7ed outline shape ( the quantity of 
data can be reduced an it docs not comprise all the 
puiiiLa in Lhe edeje of the area. Different algorithms can 
be used in order to pmrinrR thp. stylized outline shape. 
In the monitoring otation there must be certain corre- 
sponding algorithms Llic±L the outline shape can be 
recreated and disp.layed vi snslly. 

Data representing the ctylizcd outline shape is 

■v 

transmitted- In the muni Luxiny station the stylized out- 
line shape is recreated and displayed to the operator. 
The advantage of transmitting a set of data for* the 
stylized outline shape io that it can be transmitted by 



AWAPATENT AB icj uj. / ✓ 



5 



'01 04/02 14:21 FAX +46 40 260516 




AWAPATENT AB 




narrow-hand. Th« transmission can be carried out on a 
communication medium that has a bandwidth of lest* than 
10 kbiu/ss. In addition, the identity of the human- related 
alarm nhjfinf is transmitted anonymously and ie protected. 



Problems can azrioc when a monitoring module sends an 
imaye ul the monitored location to the monitoring sta- 
tion, as sperial pp.rmi ssion is often required to use such 
a monitoring module in order to protect personal privdcy. 
IL vjaii be difficult and complicated to obtain such per- 
mission. Monitoring modules in ordinary homes can also 
impose requirement o aoaociatcd with personal privacy. It 
iw usually not desirable for people who live in the hornet 
which is mom" ho-TRd to be recorded on images , among other 
thingo ao these images could be misused. 

The outline shape can be a good characteristic to 

make possible visual verification in the monitoring sta- 
ff 

tion as to whether there 13 an alarm situation or not. 

The uuLlijie; shape of a human-related object is 
relatively easy tor an npp.ratoT to recognize as a human 
figure, without the identity of the person being dis- 
closed. 

In another pretf R-rrprf embodiment, the step is includ- 
ed of comparing particular characteristics belonging to 
the object with cuiieapundinq characteristics belonging 
to an object extracted out or a previously rRnnrded 
image, in which case if the charactericticc conform to 
the extent that they can be considered to belong to Lhe 
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samp? object, data is rer.orHeH about the associated move- 
ment history of the object for classification and/or 
transmission to the monitorinq station to be recreated 
and displayed to the operator. 

If the compared characteristics conform to a certain 
predetermined extent, they are said to match and to ori- 
ginate from t.hp. namR moving nhjp.nt, rpr.nrrieH at different 
times. For example, characteristics of the distinct 
renion can be compared, such as its physical size in the 
image. ^For example, speed and direction of movement can 
be worked out. Ao the hiotory of the object io known, it 
can be used as a characteristic on which to base deci- 
sions. Thp. mnvRTTiRTih history can bp. rii spl aypd in the moni- 
toring station, together with the stylised outline shape, 
cis vtiuLury which aliow the direcLion of movement and the 
spfip.rl . 

An advantage of dicplaying the movement hiatory to 
the operator is that the decision reqarding whether there 
is an alarm situation or not is made easier-. The*, mnvpinpnt 
history which ic dieplaycd can alao be an animation of 
outline shapes originating from objeuLb tiALidLiLed conse- 
cutively in time and represent! ng th<* samp. fivhrsnpniiB 
object. The operator's evaluation of the alarm cituation 
is made consider ctbly easier when the pattern of movement 
associated with the object is displayed. For example, 
verification of persons becomes relatively simple, as 
they have a particular pattern of movement- An operator 
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is able to analyze movement information which comes from 
a very large number of monitoring modules, 

one embodiment: further comprises, the steps of 
transmitting, if the object is classified as a human 
alarm object, supplementary alarm information about the 
area, such as information of the type: intensity regions 
anr l/or line content, together- with data representing the 
area in a stylised way, and recreating and displaying the 
transmitted supplementary alarm information- 

The intensity regions make easier in particular the 
visual verification in the monitoring station, as the 
intensity reqions make the display of the object clearer. 
This appliftfl in partirular when the* ohjftnh is humsn- 
rclatcd. For example, a darker lower part of the object 
displayed to the operator can represent trousers/skirt , 
whinh makes poRnible an easier interpretation. If it is 
the object's aeeociated outline chape which in diaplaycd, 
iL udu be filled in in a suitable way. 

Partial lines within the area are extracted. Th* 
line content givee the object more structure and provides 
essential inf OiuiALiuii etbuuL Llie LaALma ul Lhe object - 
Examples ot partial lines in a person ran hp. that th<=* 
chin is added so that the head is regarded ae part of the 
rest of the body. 

with a visual display in the monitoring station the 
partial lines make the decision-making concerning the 
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alarm situation fiafiiRr for the operator. It is easier to 
make out what the outline shape represents. 

According Lu <± second aspect of Che invention, this 
comprises a morii trmng system for monitoring monitored 
locations, comprising a plurality of monitoring modules, 
each of which has a liqht- sensitive sensor for recording 
images 0 £ tne monitOTfiri Inflation, and a remote monitoring 
statio^i, the monitoring modules being arranged to carry 
out computer -baaed euialy »is of the imaqes , which com- 
prises extracting ar-Rsn from the images which differ from 
a reference image, extracting an object from the area, 
ulctafciiry iiiq the object based on characteristics associat- 
ed with the object, snnb *r a characteristic of the type: 
size, shape and/or movement history, and, if the object 
is classified as a huiuei.ii alarm object, transmitting data 
representing the aresa in a stylized way to the monitoring 
station, which is arranged to recreate and display said 
tr&nsmiLLttd data, lu the operator for verification of the 
human alarm object. 

A further advantage of having analysis and decision- 
's'. 

making in the monitoring mudule is that more reliable 
sabotage protection 3fl arthipved , If the monitoring is 
only carried out with a camera that forwards the image to 
a monitoring station, a burejlar can, for example, cut the 
connection to the monitoring station, which mRann that 
no inf nrmflti nn about the burglary can be obtained. If a 
burglar sabotages the connection between the monitoring 
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module ^and the monitoring station in a monitoring system 
according to the invention, the monitoring module conti- 
nues co record Images and analyze these, and if there is 
an alarm situation the monitoring module can store the 
alarm object in ite memory. In this way, the burglary can 
be recorded and information about the burglary can be 
retrieved from the monitoring module or sent when the 
connection is restored. The monitoring station can indi- 
cate that the connection with a monitorlnq module is 
broken and an operator can go to the monitored location 
in question and investigate whether the broken connec 
tion is due to sabotage, in addition, the operator can 
rptri eve any stored alarm object from the monitoring 
module and in thie way know whether there has been a 
burglary, for example. The monitorinq module can also 
be. arranged to store an image if the connection is broken 
and an alarm object ic detected. The information which 
is aLored requires little memory space, as not all the 
recorded images need to he shored, only data representing 
the alarm object , and po3oibly some individual images. 
With tradi Liuxictl muni Luxiny Lechniquea it would not be 
possible to store the recorriRd -images in the camera as 
this would be too memory-intensive . 

Further advanLay tta o£ Lhe muni Lux. iuy system are 
apparent from the above discussion or the method. 

In one embodiment, the monitoring system comprises a 
central panel which is arranged to receive from at least 
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one subset ot the mDTiihnring mnHnl es said data represent- 
ing the area in a otyliscd way, and to forward this data 
to the monitor, iuy a Lotion, Luqether with supplementary 
data surh as fists nf the type; date, time and informa- 
tion about from which monitoring module said data was 
iecei ved . 

The central panel nan, for p.xamplp, be located at 
an entrance to a building and also have the function 
of being able Lu dcLivdLt: cuid deactivate the monitoring 
modii I efi . Thp.rp. nan "he a large number of central panels 
connected to the monitoring at at ion. No processing of 
the received dciLa is normally carried, out in the central 
panel, except tor the addition ot extra -information which 
can be of uce to the operator in the monitoring station. 

in another embodiment- duuurdiiiy to the invention, 
the monitoring mndu I an<i Mip. monitoring station are 
arranged to communicate by wirclcoo means, such as by 
mobile Lelephuny . 

if! wireless communication, the bandwidth for the 
transmission is particularly critical. With wireless 
communication no extra cable -Iciyiny ia required, which 
reduces the costs. The monitoring Rtation can, for exam- 
ple, be a mobile terminal. An advantage of this i3 that 
the operator does not need Lu ieiiietiii in une particular 
pldue. The mobile terminal can, for example, be a mobile 
phone. As it i p: possible to show a simple object on a 
mobile phone's display, the operator can view the object 
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on the mobile phone' a display and can determine whether 
there -is an alarm siLudLion and based on this nan take 
any measures. Th.i s mRana, for example, that the operator 
can cajrry out other taoka between alarm situations <suid 
when dn alarm actuation arises he is informed of this, 
for example, by mpans of an audio signal, 

The monitoring station can also be a server Lu make 
possible moniUoi.iiiy via a computer network, as nn deri- 
sion needs? to hp taken by the monitoring station itself, 
thic can be a server. An operator can monitox from any- 
where in Lilt? world/ provided he has access CO a network 
connecr. ion . 

According to a third aspect of the invention, Lhia 
u-umprises a monitoring module for monitoring a mom* to -red 
location, whinh comprises a light-sensitive sensor for 
recording an image of the monitored location, whic-'h tuoni- 
toring, mudule its arranqed no carry our compucer-based 
analysis of the image, which comprises extracting an area 
from the image which differs from a reference imaye, 
extract inq an object from the area, classi tying the* 
object haflftd on nharact erist ics associated with the 
object, ouch as a characteristic of the type: si^ie, uhape 
and/or iiiuvemenL history, and, if the object is classified 
as a humfln alarm object, transmitting data representing 
the area in a ctyliscd way to an external unit. 

With Lhe mouiuorinq module the same advantages are 
obtained as have been discussed above in connection with 
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the claim.? concerning the method and the claims concern- 
ing the system. In addition, the following is achieved. 

In a preferred embodiment:, the memory is arranged 
to store a particular type of movement information for 
learning purposes. 

This has the great advantage that che monitoring 
mnrinlp. hp.r.nmRR hfittp.r at ignoring; falpip al arms and learns 
what doc3 not give rise to an alarm situation- The saved 
movement IniToxmciLion can, lor example, be movement 
detected outside a window. Perhaps people often walk 
pact, and arc not object a that arc to give rise to an 
alarm situation. This type of recurrinq movement in this 
area wi 1 .1 then not give rise to an alarm situation. 

In one embodiment, a oupplcmcntary acnaor ia used 
wliioli uietketj puubible even more reliable muni Loxiiig . The 
annnrsny of the whole system is thereby increased. The 
cupplementary cencor can, for example, be an infrared 
deLeuLur. The ixi£rctred detecLor extends the monitored 
wavelength range. For example, it can be a usetul addi- 
tion when an alarm object ie wearing clothcc which match 
the background in pattern and color, wliioh u<stu uduae 
problems tor the light-sensitive sensor. The=> infra-red 
detector will then detect the object from the heat it 
is emitting. 

Brief Description o f the Drawings 

Tn the following, the invention will be described in 
greater detail utilising an example of an embodiment and 
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with reference to rhe accompanying schfimstic drawings, 
which, illustrate a currently preferred embodiment of the 
monitoring system according to Llit: invention. 

Fiy. l shows a schematic diagram or the monitoring 
system according to one embodiment. 

Pig-. 2 shows a schematic bluuk diagram of che hard- 
ware in che monitoring module according to nn« embodi- 
ment . 

Fig- 3 shows a flow chart of a meLhud u£ monitoring 
according to one embodiment . 

Pig. 4 .shows how the edge of an area ie traced out 
according to one embodiment - 

Fig. 5 shows a line image in which all the edge* 
points for the area ars to be found according to one 
embodiment - 

Fiq. 6 shows a polygon! zed image according to nnp 
ernbodi mp.nt . 

Fig. 7 shows a flow chart for matcliiny an object: 
according co one embodiment: . 

Pi g . 8 shows a general block diagram of an cmbodi 
merit of the method of monitoring. 

Fly. 9a shows an example of how an alarm object-, nan 
be displayed to an npp.rator. 

Fig. 9b ahows another example of how an aletiiu object 
can be displayed L^> the operator. 

Fig. 1U Shows the monitoring system according to an 
embodiment of the invention. 
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Deflcription at a Preferred Emfrodiment 

Fig. 1 chowc cchcmatically a monitoring cyotcm with 
a riuiiib^i u£ uiuiiiLOiiay module* 1 which can tjouimuniu<=LLe 
with a morn tori ng sr.ar.irm A via a r.ransmi ssi on mRciium 'A. 

Pig. 2 ehowe a block diagram of the hardware in the 
moniLoriny module 1. The monitoring module 1 is supplied 
with a voltage to a voltage connection 4. In addition, 
the monitoring module 1 comprises a powerful calculating 
unit 5 . The monitoring module 1 comprises a communication 
unit 6. In addition, the moni toring moriu I e 1 rnmpri srs a 
light -eene it ive sensor 7, for example a CMOS sensor, for 
itsouzdiiiy iutciyeti. The BtJiittor 7 ib inLfciyrriLed into u chip 
and also has a lens arrangement a. The sensor 7 provides 
an analogue output aignal which is forwarded to an A/D 
converter 9 for conversion into a digital signal . In 
addition, the monitoring module 1 comprises a random 
access memory 10. The monitoring module 1 operates with 
a suitable operating system and can carry out advanced 
image processing. The monitoring module 1 also comprises 
a permanent memory 11 for computer code and other data 
which has to be saved in a non-volatile memory. In addi- 
tion, a lighting device i^ can be arranged in association 
with the monitoring module 1 to illuminate dark monitored 
locations. The lighting can advantageously be carried out 
in Lhe in£xcixed range as the monitoring module i will 
then not emit any visible light, which will malcps it very 
difficult to find in dark monitored locations. Thie 
■7 
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results in increased reliability, as the riangpt-r n-F sabo- 
tage ie reduced. Infrared diodco arc aloo cheap and do 
not -use much power. The moniLoied luudLiun la limited by 
Che field of vision of the sensor 7 and its ssnnni steel 
optics. All the components comprised in the monitoring 
module 1 are advantageously liiLey-Lett-ed on circuit 
board. The advantage of this is that the monitoring 
module 1 ie much more stable, that ic it io much less 
sensitive to interference and has fewer poiiiLti whux'e 
sabotage can occur. 

The alarm criteria of the monitoring module 1 are 
stored in the permanent memory 11 and uclii be chdixyed £x*om 
the monitoring station 3 by the transmission ot new soft- 
ware from the monitoring station 3 to the monitoring 
module 1. The alarm criteria can be different for diffe- 
rent monitoring modules 1. The alarm criteria can be 
chanrjed dependent upon the permitted power consumption 
and external conditions. The external condiLiunt; uan, lur 
example, be a monitor that is switched on, curtains that 
move or other permitted movements that take place at the 
monitored location. The alarm criteria are, of course, 
also set in accordance with the type of object and/or 
pattern of movement for which the monitoring module 1 is 
to give an alarm. 

with jLefeientje Lu Fie?. 3 and Fiq . 9, the monitoring 
function ot the monitoring mnHnlp 1 will now be describ- 
ed. In a recording step 100, the eeneor 7 continually 
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records linages of the monitored location. A reroTrJ^.r? 
image is converted in a conversion cfcep 110 from an ana- 
log signal to a digital signal in the A/D cuiiveitex' 9. In 
the calculating unit 5 a difference images ifl nrpated in a 
difference step 115 by a subtraction between a reference 
image and the recorded image in quetiUiuii. The reference 
imaqe can be created using one or more algorithms trom 
one or more previous images, one or more background 
images or a combination of both. Averaging or Kalman 
filtering can be carried out on a number ot said rer.orrifirJ 
images to create a reference image. The reference image 
is normally updated at regular intervals. Areas die 
extracted from the difference image in an area extraction 
step 120, for example by refining the difference image, 
and wc get what we call a divergence image which is shown 
in Flo; 8. The resulting areas consist of a defined mim- 
hp.r of pi ypl e in the recorded image. Several areas are 
mutually exclusive so that a particular pixel can only 
belong to one area. Areas represent a change of some kind 
that has nrmrred in the recorded image in comparison 
with the reference image- These changes can, for example, 
be Liic±L a person has entered the monitored location, a 
bird has tlown into hh« mrmitored location or a tree is 
blowing in the wind in the monitored location. In a fil- 
tration step 130 a convent! unci 1 iuiaye filtration can be 

carried out to remove noise. When the areas ha vr .been 

n 

extracted, an object is associated with each area in an 
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object extraction step 14 u for easier management ot the 
different areas . Instead of etoring imagec of an area, 
selected area characteristics are stored, such eta une ur 
more of, for example, coordinates in the image, size, 
outline, average intensity, circumference and intensity- 
variations. 

W^th reference to Figs 4 -fa, a method will now be 
described of producing the outline of the area, which 
area in this case represents a person. Fig. 4 shows how 
an extracted area is traced out along its edge by a 
search function which has a clock-hand algorithm. The 
clock-hand algorithm traces along the edge of the area 
until it reaches the point where it started, ±n detail, 
the following takes place. A starting point is first 
looked for on the edge of the area. As long as no start 
node is encountered and there are unexplored ways for- 
ward, a clock-hand is moved clockwise at a distance of 
one pixel from the previous position until a new edge: 
point is encountered, if the clock-hand's new position 
is the start position, then a new unexplored way is 
looked for. If there is no way forward, the algorithm is 
to be discontinued, otherwise the algorithm continues and 
the unexplored way fnrwarri fmm t.he* start node which was 
found ic marked ao explored. 

Fig. 5 shows an outline of ta.ii ctitJd which represents 
a person, m Kig. 6 a polygon has been fitted to tViR 
traced-out path. The polygon is adjusted using an angle- 

22 : 
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minimizing function. The angle -minimi 7.i ng function is as 
follows. A starting point ie eet on the edge as the most 
recent point. As long as the end point it> 
nut encountered, then the edge is traced out-.. The angle 
difference between the tangent vector of the moct recent 
point and the tangent vector of Lliti pxeseiit position 
around the edge is calculated. If the angle ditf.ftrAncp. . 
is Qreater than a particular limit, then thic poaition 
io saved as a node, and the position is set as Lhe niuat 
recent point. It is also possible to use other type* of 
outline shapes than polygons , for example, splines. A 
spline curve is defined mathematically by a number of 
control points and a function which describes the appear- 
ance of the curve between the control points . Normally/ 
the function io fixed and only the control points are 
used to define the curve. To fit such a curve to an oait- 
line» imagp. it is necessary to have an initial value, a 
criterion for where the curve fits the outline and. a 
search strategy to fit the curve to the outline. Normal- 
ly, the position of the curve in the previous image in a 
sequence of image c io used as an initial value. If start- 
iuy from scratch, another method muse be used, for exam- 
ple by starting with a large circle that is guaranteed to 
include the outline. The criterion for fitting the uuive 

the ^outline can be ciLhtsx Lhe distance to the detected 
outline or based on the gradient in the imflgp. Tn the 
latter r.s.qp., it is required that the curve should be 
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placed where the qradlent is the greacest . The search 
«t"rategy consists normally of some standard optimisa- 
tion method in order to minimize the criterion in the 
dedruh strategy. The advantage of a spline representa- 
tion fnr npt-imi 7.^tion is that only the control points 
need to be used as variables, which leads to increased 
tspeed. Fur mure details about: spline fitting, see the 
arficl.e "Fast least-square curve fitting using quasi- 
orthogonal aplincs", Myron Flickner, CTames Ilafner, 
Eduardo J. Rodriguez and L . C. Sanz. 

AfhRr mmhi n -i rig the object's characteristics the 
object io stored in a storage step 150 in the form of 
iLts uharac Lexis Lies in the random access memory 10 and 
s mahnhing of the object with a stored object from a 
previously recorded image ia carried out in a matching 
step 160. The objects' characteristics are compared with 
each other to produce an inrl-instinn of how well they 
conform . By minimising the matching difference for all 
objects at the same Liui^s, d yuud approximation is obtain- 
ed ot the object's p-r*=vi mis history, which is known as 
tracking. Matching is carried out by gradual stages in 
such a way LheiL iL is only the object in the most recent 
image that is compared with what was storp.ri from the pre- 
vious image or, alternatively, from earlier images. After 
matching it can t>e seen for a particular objcuL wheLher 
the oblect was recorded in a previous image and it so 
which object it was in the preceding image. As the pre- 
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vlous object: possibly in curn has a' direct connp.r:tinn 
to the previous object , a chain ie built up of the total 
history of the current object. 

The matching method is illustrated in h'ig. v and 
comprises the following. The object} is compared with all 
previous objects which were extracted fxom Lhe previous 
Image in a combining step ^uu. a calculation of the 
degree of matching of the combinations is carried out in 
a calculation step 2X0. The outcome ; of the calculation of 
the matching is normalized so that the result is a value 

b^tweea 0 and 1 . The value 0 indicates that the compared 

i 

objects do not have any characteristics that conform, 
while the value l indicates that the objects are precise- 
ly identical. If the combination with the highest degree 

i . ; 

of matching, for the object and a previous object, 
exceeds a predetermined value, it is determined in a 
riptprmination step 220 that there is a match. In the 
matching step 1C0 a decision is taken concerniag a numbex 
o£ characteristics of the object, which characteristics 
a-rft also weighted according to their importance. A method 
that incrcaoca the probability of a i correct matching is 

Lu e^Lract the intensity regions within an abject. The 

I 

method is based nn flRgmpnting an area based on one of its 

*/ i 

intencity characteristics. The different segments have an 

average intensity and a apeuiritiQ died. Di££erent methods ; 

can be used for the segmentation itseit . Rxampl p.s of snch 

j 

meithnri.s are quant if ying of the intensities, refining of 

i I 
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Che incensicies or classification of diffprent pattern 
segments by means of, for example, Bayer's classifica- 
tion about which more can be xecul in R-C. Gonzales, 

R.E, W«>ods, "Digital image Prnr.p.RRing", Addison Wesley. 

! 

The different segments can then be paved efficiently 
in various ways. One way is Lu save j the outlines of the 
different segments or carry out a Run Length Knr.nriing 
(RLE) of the different segments ac a pixel map. 

In the classification step 170jLhe ubjecL is classi- 
fied based on the onjecrt. 'Ft hi atnry and nhsracteriistics, 
based on which the decision engine can determine whether 
the object is an alarm ubjeoL ui nut. For each recorded 
image the decision engine has access to all the objects 
and their histories which were extracted from the image . 
Initially, the decision engine views the whule liiyLuiy ol 

Che different objects and determined from this whether it 

*/ ! 

is a human alarm object- It is sufficient for an object 

i 

to have been an alarm object aL some Lime during its 

i 
i 

history for this to give rise to an ; alarm situation tor 

i 

the rest of its life. The object must fulfil a number of 

criteria in order to be classified or a decision reached 

I 

concerning its being an alarm object. In nrdsr t-.n achieve 
a particular level of confidence, for example, its hie- 
tory must be sufficient. For example, it ucm be determin- 
ed LhdL in uxder Lg cause an alarm a particular object 

must have been tol Inw^H for- at. "least 10 images back in 

i 

time. Other criteria for claccifying the obj'cct as an 

j 
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1 
I 

i 
I 

alarm object can be that for Ehe whple of its lite ih 

i 

covered a certain minimum distance and had a top speed 
which is not less than a certain lower limit. 

XL the object is classified asjan alarm object*., t-.hai- 
i£3 it", is nlasflified as a person whose behavior is not 

i 

permitted, data representing the area in a stylized way 

i 

la forwarded in a transmission step! 180 via a communica- 
tion cable 2 to an operator at a monitoring station 3 for 
dicplay of the object in a display step 190. The trans - 
mission can be carried out at less than iu Wbit/s and 
still transmit- a suffinipntly large [amount of information 

i 

to make possible a verification of the alarm object. How 
maxiy o£ the alarm object's characteristics are sent to 
the operator, and when, can be varied and determined by 
the ueerc of the monitoring system. \ 

if Lhere dre several oblects iij. a recorded image, 

i 

they are all investigated in the Ramp. way. 

What ia transmitted and displaced to the operator in 
the display tiLep 190 is the outline (of the area. The out- 
line can be displayed sr sn animation corresponding to 
the recorded object in recordingc made consecutively in 
time. iHg. 9a shuwb out: alternative for displaying the 
object to the operator. This shows the nhjRr.t'R present 
outline and a series of previouc outlines which show how 

! 

the object has moved based on previously itscjuided imaqes . 



Ficjs 9b shows a further alternative 
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the operator. The outline of the object shows where the 
object has been situated in different recordings. 

I 

In addition, data which represents the line content 
u£ an object can be sent together w;.th the outline shape. 
The main aim of visualizing the line content in the area 
is to give the visual display of the transmitted inforiM- 
tion of the object more structure aad essential informa- 
tion about the nature o£ its texture. There are a number 

f 

of different octo of lines that can! be extracted from a 
texture. Edges, can be refined out of the derived, texture 
Tht*. who! p. arp^i of the object can he 



this way a kind of "stickman" is obtained. This stickman 



its quite* aeuaiLivt; to local changes 



made thinner and in 



and is therefore not 



a Iways Riiif.ahlp. Tr» addition, it originates from the out- 
line and not from the texture. The texture can be regard- 
ed us a Lopoqraphy. A set of lines dan be all the hill- 
tops that can be rieflrri be=;ri purRly insthRTTiati cal ly as, for 
example, caddie pointo and local maximums and mini mums , 
etc- The lines are usually nuL pdiLiculdrly thin, but 
often have some torm ot width. Tn nrrier to obtain nar- 
row distinct lines, a method can be jueed that io called 
"thinning"- Thinning "edLb away" the edqes of the thick 
lines without them being "eaten awa^f" completely. 
Expressed simply, all the lines are made equally narrow 
(uoually 1 pixel in width) . In certain cases, the result 



is not a number of individual lines 



Then a^l the partial lines ran hp rpgsrded as separate 
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lines and bepdreiLed from the other tines, in order tn 
make the vi mia I result as clear as possible; it can sorne- 
timse be neccooarj T to weed out the 'informgition. Fur exam- 
pic, if there its a checked shirr in the texture, thR-re* 
can be quite a lot of "lin^g clustered together. The 
weaker 1 inec or come of those which are too close Loye- 
ther can then adveiiiLay euusly be removed. Finally, the 
lines (jan be rpprpflpnteci in a number of different wayc . 
One way is in the form of pixels. Each line is described 

i 

by the s«L ul pixels it contains. Another way is lxne 
setjuences . A line sequence is f-itt-^rp to each line seg- 
ment. Each line ic represented here by a series of 
straight lines which LuyeLhe-c approximate to the original 
line. A further way is in the form of a spline, A spline 
is fitted to the line in quection. 

In addition, iiiLexiuiLy reqions 
the outline shape and the line contifsnh or only with the 
outline shape in order to make caaicr a visual evaluation 
which, for example, takes place iu Lliis case when the 

to the rjJjR-r^ tor . The intensity 



can be sent with both 



outline shape is displayed 



T^cji ons are to reproduce ae closely 
acteristic features of an objeuL. In order to achieve a 
yuud sepjnentation it is first necessary to define which 
nharanheristics of the texture of tt 
ther. Examp 1 e c of ouch characteristi 
whole died ia to have the same intensity with only sma I I 
deviations. Another character! n o^n be that the 
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^ariaiife of che area is to be less than a partimilar mea 



sari be that ttie area 
characteiiaLiuB ; such 



Another way can be quantifying 
hi t -depth to give distinct regions . 



are combined.' 
the area ac a' lbw 
A further way, ie to 



mirement . A further characteristic 
hac a particular set of statistical 

as eivtiidMe value, variance, correlation between arent 
pivelR, etc. There are different ways of segmenting , the 
different areas - In order to segment Llit; di£Ierent areas 
wiuh the characteristics as mentioned above, a number of 
rtitterent methods can be used. One way ie "Split jand 
Merge 11 which is an algorithm that successively divides an 
area into smaller areas until the various partial, areas 
fulfil a particular requirement. Subsequently ( the areas 
which have the same characteristics 



plant a occd in the texture and to let this area grow as 
lung as the new pixel conforms with the characteristics 
ot the new a-r^.a . Pixels are marked as allocated when they 
are included in an area. When an area cannot grow; any 
largex , then this area is completed and a new seed is 
planted in Annthpr location. It is also possible to have 
a plurality of eeedc growing at the same time in paral- 
lel. Another wciy can be Bayes classification according to 

i 

a number of selected region characteristics in the t'ex- 

i" 

ture . 

In order to represent the Qi If ex-en u regions , ' a num- 
ber of -^different methods can be used. A first method is 
"Run Length Rncnding" (RLE) of the different regions' 
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pixels. The value ot the datterent pixels is which arftfl ! 

they belong to. Another method ic polygon rcprcacntation. j 

i 

This method fits a polygon Lo Lhe axed. The pulyyun uau ; 

i 

share points wir.h other areas and with t-.h« miflinp nt the | 

object. A further method is spline representation wl^ich j 

i 

deliuiiUa Llie ctitict by a tspline . An dilvdiiLaye la that the 
amount o£ data is smaller and the fit is better. A dis- 
advantage is, however, that most spline methode cannot ; 
share common points and that the fitting is more calcu- ; 
lating- intensive . 

Once the regions and the lines J have been represent- 
ed, it is only a set of data that is sent via. a L-Lcuitsiuia- \ 
sion medium. The only restriction is that both the trans- j 
mitter and the receiver, which in tikis case :are the moni - ' 
toring module 1 and the monitoring station 3, must inter- ! 
pret the information in the same way. They must have the ; 
same model of the information. 

With reference to Pig. 10, a further embodiment ! 

according to the invention will nowjbe described, a ;num- j 

ber of monitoring modules 2 0 are arranged at suitable ; 

locations in a building. These monitoring modules 2 0 are J 

connected by wireless means to a central panel ^l which ! 

i r arranged at the entrance to the building. By means of ! 

the central panel 21 the alarm in the building can be ; 

activated and Jc-duLivctLeQ . The Ljeiitral panel 21 is in 

; . : . I 

turn in wireless communication with a mom tnn ng Rtatmn i 

22. The monitoring station 22 has a ; number of central ! 

! 

i • ! 
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panels 21 connected to it. b'ach monitoring module cion- 

j i 

tini.ially records images of the location it io monitoring. 

j I 
An image recorded in a. monitoring module 2 0 is cjutupaxed 

in Lhe uioiiiLaxiny module 2 0 with a reference image and 

I _ i 

any ci i vfirgpnrp areas are extracted, i When a divergence 

area has been extracted; an object Ls derived wiLh itsso- 

i : 
i ; 

ciaLed characteristics such as the object's size, shape, 

I 

rii-rection o± movement and speed. The direction of move- 
ment and the speed can be derived according to the above- 
mentioned technology. The outline s^ape of the object is 
a. I so rift-ri vpiri annording to the above-mentioned technology. 
The obgect is classified in the monitoring module 2 0 

baaed un ILk characteristics- if th6 person moves in a 

! ! 
pa-rti cxilar direction at a particular speed, the person 

ic caid to conctitutc an alarm object. If the object! is 



clctysilied as an alarm object, data 
shape and data about the objp.nt'R ri 



about the out 1 iije 
rection of movement 



and speed are tranomittcd to the central panel 21- The 

central panel 21 is arranqed to add I information about 

j | 

the date, fimp. anH in which monitoring module the alarm 

i • j 

occurred- The data now c out a i no the! outline shape, direc- 



tion of luuvtjmeiiL , apeed of movement; date, time and | 

j i 
information about which monitoring module 20 gave the 

I ■ \ 

alarm. No processing of the recorded alarm object is 



carried i out in the central panel 21 
forwarded to the monitoring station 



station 



22 rnmpri qp.q monitors which 
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I 
i 

r time and from Which 
are also shown on the 
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li 



and speed of the 



the monitors and also the direction 
object by means of arrows. The date 
moiiiLuiixiq module 2 0 the alarm came 

mnnihn^R. The alarm operator- can now reach a decision 
regarding appropriate further measures. If a monitor iny 
module 20 is put: our of action for any reason, for exam- 
pi r hy sabotage, the central panel 21 sends information 
about thic to the monitoring station 22, which can then 
put the fault riqht. 

Rvsri t.hnngh a wppci al embodiment of the invention 
has been described above, it will be obvious to a persoli 
akilled in the art that many alternatives, modif icatjions 
and varistinnfl arp possible in the !.irjht of the aboye 
description. Communication can take place via radio J for 
example GSM or Bluetooth, instead oV. the outline sh^pe, 
tor example, nthnr t.ypp.R of styl i zea information about 
the object can be transmitted which 

the ope j. a Lux Lu uee whaL the transmitted data represent- 
ing the object represents . For pvample, the skeleton form 
of the object can be transmitted or 

tion wheie Llits object is filled in so that its shap^ can 
toe displayed visually. 



i, 



make it possible for 
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